"The highlighted tokens are primarily Japanese grammatical particles, noun and verb suffixes, and function words that structure sentences, indicate relationships, or mark topics, objects, and actions. These tokens are essential for conveying grammatical roles, sentence boundaries, and discourse structure in Japanese text."
Score Type | Accuracy | Precision | Recall | F1 score | TPR | TNR | FPR | FNR |
---|---|---|---|---|---|---|---|---|
detection | 0.87 | 1.0 | 0.74 | 0.851 | 0.74 | 1.0 | 0.0 | 0.26 |
fuzz | 0.9 | 0.976 | 0.82 | 0.891 | 0.82 | 0.98 | 0.02 | 0.18 |